Accuracy Of Face Recognition Systems Research Articles

On the Potential of Algorithm Fusion for Demographic Bias Mitigation in Face Recognition

With the rise of deep neural networks, the performance of biometric systems has increased tremendously. Biometric systems for face recognition are now used in everyday life, e.g., border control, crime prevention, or personal device access control. Although the accuracy of face recognition systems is generally high, they are not without flaws. Many biometric systems have been found to exhibit demographic bias, resulting in different demographic groups being not recognized with the same accuracy. This is especially true for facial recognition due to demographic factors, e.g., gender and skin color. While many previous works already reported demographic bias, this work aims to reduce demographic bias for biometric face recognition applications. In this regard, 12 face recognition systems are benchmarked regarding biometric recognition performance as well as demographic differentials, i.e., fairness. Subsequently, multiple fusion techniques are applied with the goal to improve the fairness in contrast to single systems. The experimental results show that it is possible to improve the fairness regarding single demographics, e.g., skin color or gender, while improving fairness for demographic subgroups turns out to be more challenging.

Joint Masked Face Recognition and Temperature Measurement System Using Convolutional Neural Networks

With the outbreak of COVID-19, epidemic prevention has become a way to prevent the spread of epidemics. Many public places, such as hospitals, schools, and office places, require disinfection and temperature measurement. To implement epidemic prevention systems and reduce the risk of infection, it is a recent trend to measure body temperature through non-contact sensing systems with thermal imaging cameras. Compared to fingerprints and irises, face recognition is accurate and does not require close contact, which significantly reduces the risk of infection. However, masks block most facial features, resulting in the low accuracy of face recognition systems. This work combines masked face recognition with a thermal imaging camera for use as an automated attendance system. It can record body temperature and recognize the person at the same time. Through the designed UI system, we can search the attendance information of each person. We not only provide the design method based on convolutional neural networks (CNNs), but also provide the complete embedded system as a real demonstration and achieve a 94.1% accuracy rate of masked face recognition in the real world. With the face recognition system combined with a thermal imaging camera, the purpose of screening body temperature when checking in at work can be achieved.

Missing Person Identification

At present the Computer automated Face recognition systems are used for personal identification, but the Age variations of an individual poses a serious problem for it. Designing an appropriate feature representation and an effective matching framework for age invariant face recognition remains an open problem. To classify person age using faces author using combination of two CNN where one CNN will extract face features which can help in identify changes in face over time and second CNN helps in predicting/ classifying age. Face aging causes intra-subject variations (such as geometric changes during childhood & adolescence, wrinkles and saggy skin in old age) which negatively affects the accuracy of face recognition systems. Therefore, this paper proposes a unified, multi-task framework to jointly handle these two tasks, termed MTLFace, which can learn age-invariant identity-related representation while achieving pleasing face synthesis. Specifically, we first decompose the mixed face features into two uncorrelated components—identity- and age-related features—through an attention mechanism, and then decorrelate these two components using multi-task training and continuous domain adaption. d. This system will decrease the crimes and ensure the security in our society.

A Hybrid Method of Enhancing Accuracy of Facial Recognition System Using Gabor Filter and Stacked Sparse Autoencoders Deep Neural Network

Face recognition has grown in popularity due to the ease with which most recognition systems can find and recognize human faces in images and videos. However, the accuracy of the face recognition system is critical in ascertaining the success of a person’s identification. A lack of sufficiently large training datasets is one of the significant challenges that limit the accuracy of face recognition systems. Meanwhile, machine learning (ML) algorithms, particularly those used for image-based face recognition, require large training data samples to achieve a high degree of face recognition accuracy. Based on the above challenge, this research proposes a method for improving face recognition precision and accuracy by employing a hybrid approach of the Gabor filter and a stacked sparse autoencoders (SSAE) deep neural network. The face image datasets from Olivetti Research Laboratory (OLR) and the Extended Yale-B databases were used to evaluate the proposed hybrid model’s performance. All face image datasets used in our experiments are grayscale image type with a resolution of 92 × 112 for the OLR database and a resolution 192 × 168 for the Extended Yale-B database. Our experimental results showed that the proposed method improved face recognition accuracy by approximately 100% for the two databases used at a significantly reduced feature extraction time compared to the current state-of-art face recognition methods for all test cases. The SSAE approach can explore large and complex datasets with minimal computation time. In addition, the algorithm minimizes the false acceptance rate and improves recognition accuracy. This implies that the proposed method is promising and has the potential to enhance the performance of face recognition systems.

Facial Makeup Detection Using Multi-Scale Local Binary Patterns and Convolutional Neural Network Fusion

This study presents a novel facial makeup detection scheme using fusion of multi-scale Local Binary Patterns (ms-LBP) texture methods and convolutional neural network (CNN) deep learning extractor. Facial makeups affect the accuracy of face recognition systems due to appearance alteration of individuals. In order to fuse the facial features, the proposed scheme first considers concatenation of extracted global histogram of a whole image using three different LBP operators. The LBP scales are used to extract and then concatenate the local histogram of overlapping and nonoverlapping blocks of images. This way utilizes the advantages of microtexton information of local primitives besides the extracted global textures. Finally, the extracted features using CNN feature extractor are combined with global and local multi-scale textures. In general, CNN deep learning extractor learns high-level discriminative characteristics of images and therefore the proposed system improves the facial makeup detection rate by involving both microtexton and discriminative information of facial images. In addition, the proposed method attempts to select the optimized subset of facial features to increase the detection performance of system by applying Particle Swarm Optimization (PSO) technique after feature level fusion. The paper uses Support Vector Machine (SVM) classifier for classifying the facial vectors into makeup or no-makeup classes. The proposed scheme is then evaluated using YMU, VMU and MIW facial makeup databases with consideration of light, medium and heavy makeups on several datasets. Experimental results analysis clarifies the effectiveness of proposed facial makeup detection framework of this study.

Improved Accuracy of Face Recognition System to Identify Criminal Based on Innovative Feature Extractor to Improve Accuracy Using Deepface over LBPH Algorithm

Improved Accuracy of Face Recognition System to Identify Criminal Based on Innovative Feature Extractor to Improve Accuracy Using Deepface over LBPH Algorithm

Combined 2D/3D approach for improving the accuracy of face recognition systems using deep learning

Combined 2D/3D approach for improving the accuracy of face recognition systems using deep learning

An improved age invariant face recognition using data augmentation

In spite of the significant advancement in face recognition expertise, accurately recognizing the face of the same individual across different ages still remains an open research question. Face aging causes intra-subject variations (such as geometric changes during childhood adolescence, wrinkles and saggy skin in old age) which negatively affects the accuracy of face recognition systems. Over the years, researchers have devised different techniques to improve the accuracy of age invariant face recognition (AIFR) systems. In this paper, the face and gesture recognition network (FG-NET) aging dataset was adopted to enable the benchmarking of experimental results. The FG-Net dataset was augmented by adding four different types of noises at the preprocessing phase in order to improve the trait aging face features extraction and the training model used at the classification stages, thus addressing the problem of few available training aging for face recognition dataset. The developed model was an adaptation of a pre-trained convolution neural network architecture (Inception-ResNet-v2) which is a very robust noise. The proposed model on testing achieved a 99.94% recognition accuracy, a mean square error of 0.0158 and a mean absolute error of 0.0637. The results obtained are significant improvements in comparison with related works.

Survey of non-intrusive face spoof detection methods

Biometrics are distinct physiological characteristics used to describe individuals. Compared to the traditional access control methods such as passwords and Person Identification Numbers (PIN) which can be forgotten and shared easily, biometrics are widely used in authentication systems. Even though the accuracy of face recognition systems is lower than that of the systems using fingerprint, iris, etc. as the acquisition devices of the latter evade the affine and photometric transformations, recognition systems with the face as a trait are widely used due to the contactless and non-intrusive nature of the acquisition device-camera. As the cameras are in-built in most of the handheld and portable devices such as mobile phones and laptops, the uncontrolled and/or unregulated immediacy of sharing the photographs via messaging services and uploading on social networks entices the attackers to create spoofs to deceive a face recognition system. Hence, it is necessary to incorporate a spoof detection algorithm in recognition systems before revealing the identity. This paper gives an overview of the steps involved in the face spoof detection process, the various databases available, the different measures to discern between live and spoof images, aligned with the perceived observance, the binary classifiers used, and the performance evaluation parameters revealed in the literature.

Normalization of Facial Pose and Expression to Increase the Accuracy of Face Recognition System

Normalization of face poses and expressions is one of the critical steps to restore the raw appearance of faces in uncontrolled conditions (in the wild) and help improving the performance of face recognition systems. Researchers in the field of computer vision has for a long time trying to find methods to normalize of poses and expressions to gain accuracy improvement for the face recognition process. The process of normalization is related to the face alignment stage, which aims to find face landmarks (point markers of facial features). From this face landmarks, the poses and facial expressions that are different from canonical face obtained for later transformation. This paper discusses the method of normalizing poses and facial expressions that have been proposed by researchers from geometrical-based transformation to the current state of the art, which is a deep learning-based system.

How re-training process affect the performance of no-reference image quality metric for face images

The accuracy of face recognition systems is significantly affected by the quality of face sample images. There are many existing no-reference image quality metrics (IQMs) that are able to assess natural image quality by taking into account similar image-based quality attributes. Previous study showed that IQMs can assess face sample quality according to the biometric system performance. In addition, re-training an IQM can improve its performance for face biometric images. However, only one database was used in the previous study, and it contains only image-based distortions. In this paper, we propose to extend the previous study by use multiple face database including FERET color face database and apply multiple setups for the re-training process in order to investigate how the re-training process affect the performance of no-reference image quality metric for face biometric images. The experimental results show that the performance of the appropriate IQM can be improved for multiple databases, and different re-training setups can influence the IQM's performance

Impact and Detection of Facial Beautification in Face Recognition: An Overview

Facial beautification induced by plastic surgery, cosmetics or retouching has the ability to substantially alter the appearance of face images. Such types of beautification can negatively affect the accuracy of face recognition systems. In this work, a conceptual categorisation of beautification is presented, relevant scenarios with respect to face recognition are discussed, and related publications are revisited. Additionally, technical considerations and trade-offs of the surveyed methods are summarized along with open issues and challenges in the field. This survey is targeted to provide a comprehensive point of reference for biometric researchers and practitioners working in the field of face recognition, who aim at tackling challenges caused by facial beautification.

Performance evaluation of no-reference image quality metrics for face biometric images

The accuracy of face recognition systems is significantly affected by the quality of face sample images. The recent established standardization proposed several important aspects for the assessment of face sample quality. There are many existing no-reference image quality metrics (IQMs) that are able to assess natural image quality by taking into account similar image-based quality attributes as introduced in the standardization. However, whether such metrics can assess face sample quality is rarely considered. We evaluate the performance of 13 selected no-reference IQMs on face biometrics. The experimental results show that several of them can assess face sample quality according to the system performance. We also analyze the strengths and weaknesses of different IQMs as well as why some of them failed to assess face sample quality. Retraining an original IQM by using face database can improve the performance of such a metric. In addition, the contribution of this paper can be used for the evaluation of IQMs on other biometric modalities; furthermore, it can be used for the development of multimodality biometric IQMs.

Affine‐scale invariant feature transform and two‐dimensional principal component analysis: a novel framework for affine and scale invariant face recognition

Face recognition (FR) is one of the most effervescent fields of research with extensive applications that span numerous domains, and it stands resolutely as one of the most challenging problems in computer vision. The accuracy of FR systems is severely affected when two images under consideration for a match, vary in their scale and/or affine angles. The prevalent affine and scale invariant recognition systems have been predominantly developed only for objects, and hence in this study, the authors propose a novel approach for faces based on the affine‐SIFT (ASIFT) and two‐dimensional principal component analysis (2DPCA) techniques, to accomplish the formidable task of facial image recognition, invariant of scale and affine angles, i.e. the ability to simulate with enough accuracy, all the distortions caused by the differences in resolution and the variation of the camera optical axis direction. In the formulation of ASIFT‐2DPCA, they investigate three different variants of 2DPCA: classical 2DPCA, quaternion 2DPCA and sparse 2DPCA to gauge as to which is more effective. The authors'experimentations will demonstrate that the proposed approach can robustly handle affine and scale variations, and hence provide better accuracy and matching performance than the state‐of‐the‐art methodologies.

Error Rates in Users of Automatic Face Recognition Software.

In recent years, wide deployment of automatic face recognition systems has been accompanied by substantial gains in algorithm performance. However, benchmarking tests designed to evaluate these systems do not account for the errors of human operators, who are often an integral part of face recognition solutions in forensic and security settings. This causes a mismatch between evaluation tests and operational accuracy. We address this by measuring user performance in a face recognition system used to screen passport applications for identity fraud. Experiment 1 measured target detection accuracy in algorithm-generated ‘candidate lists’ selected from a large database of passport images. Accuracy was notably poorer than in previous studies of unfamiliar face matching: participants made over 50% errors for adult target faces, and over 60% when matching images of children. Experiment 2 then compared performance of student participants to trained passport officers–who use the system in their daily work–and found equivalent performance in these groups. Encouragingly, a group of highly trained and experienced “facial examiners” outperformed these groups by 20 percentage points. We conclude that human performance curtails accuracy of face recognition systems–potentially reducing benchmark estimates by 50% in operational settings. Mere practise does not attenuate these limits, but superior performance of trained examiners suggests that recruitment and selection of human operators, in combination with effective training and mentorship, can improve the operational accuracy of face recognition systems.

An Experimental Evaluation of Three Classifiers for Use in Self-Updating Face Recognition Systems

Previous studies have shown that the accuracy of Face Recognition Systems (FRSs) decreases with the time elapsed between enrollment and testing. The main reason for the decrease is the changes in appearance of the user due to factors such as ageing, beard growth, sun-tan etc. Self-update procedure, where the system learns the biometric characteristics of the user every time he/she interacts with it, can be used to automatically update the system. However, a commonly acknowledged problem is the corruption of biometric traits due to misclassification. In this article, we test FRS, based on three classification algorithms, on two challenging databases, GEFA and YT, with 14 279 and 31 951 images, respectively. Our results suggest that complex, state-of-the-art classifiers that make use of user-specific models, need not be the best choice for use in self updating systems. In other words, tolerance to corrupted training data decreases as the complexity of the classifier increases.

Selection and fusion of facial features for face recognition

This paper proposes and investigates a facial feature selection and fusion technique for improving the classification accuracy of face recognition systems. The proposed technique is novel in terms of feature selection and fusion processes. It incorporates neural networks and genetic algorithms for the selection and classification of facial features. The proposed technique is evaluated by using the separate facial region features and the combined features. The combined features outperform the separate facial region features in the experimental investigation. A comprehensive comparison with other existing face recognition techniques on FERET benchmark database is included in this paper. The proposed technique has produced 94% classification accuracy, which is a significant improvement and best classification accuracy among the published results in the literature.